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1 DIS[R!5l!IiON/AVAIlABIllTy  CODES  | 

it  SPrciArl 

Let  X(t) , t ^ 0,  be  a homogeneous  Poisson  process  with 

/s 

arrival  rate  6 . Sequential  estimation  procedures  ^ 

considered  with  loss  due  to  estimatdon  L(0,§)  = 6 (6-9)  , 

and  Scunpling  costs  involving  both  time  and  arrival  costs.  In  this 
context  the  Bayes'  sequential  procedure  is  obtained  in  a simple 
computable  form.  The  large  sample  properties  of  the  procedure  are 
then  studied  when  0 is  fixed  but  un)cnown,  and  the  Bayes'  stopping 
rule  T is  shown  to  be  asymptotically  equivalent  to  the  best  fixed 
Scimple  size  procedure  when  0 is  known.  Asymptotic  normality  of 
the  Bayes'  sequential  estimator  0^  of  6 is  also  shown. 
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THE  CONTINUOUS  TIME  BAYES’  SEOIHINTIAL  PROCEDUIIE 
FOR  ESTIMATING  THE  ARRIVAL  RATE  OF  A 
POISSON  PROCESS  AND  LARGE  SAMPLE  PROPERTIES 

C.  P.  Shapiro  and  Robert  Wardrop 


1.  Introduction.  Conditional  on  the  value  of  0,  0 > 0,  let  X(t) , t ^ 0,  be  a 
homogeneous  Poisson  process  with  rate  6 . Let  3(t),  t ^ 0,  denote  the  sigma  algebra 
generated  by  X(s)  , O ^ s £ t . Sequential  estimation  procedures  of  the  form  ) 

are  studied,  where  0 is  a stopping  time  with  respect  to  3(t),  and  9^  is  an  5 (O) 
measurable  random  variable,  with  3(0)  the  sigma  algebra  of  events  prior  to  0 
The  loss  due  to  estimation  is 

(1.1)  L(e,0)  = 0"^(0-O)^  . 

This  loss  measures  estimation  error  in  terms  of  standard  deviation  0 ^ forcing  more 
precision  at  smaller  9-values.  The  loss  was  suggested  by  Dvoretzky,  Kiefer,  and  Wolfowitz 
(1953)  and  Hodges  and  Lehmann  (1951) . 


The  cost  of  sampling  consists  of  two  components:  c^  > 0,  the  cost  of  observing  one 

arrival,  and  > 0,  the  cost  of  observing  the  process  for  one  unit  of  time. 

A 

In  Section  2,  the  Bayes  sequential  procedure,  (T,  / is  derived  using  a gamma 

prior  on  0 and  the  loss  and  cost  struc  ures  described  above.  In  Sections  3 and  4,  the 

asymptotic  properties  of  (x,  0^)  are  examined  without  reference  to  the  Bayesian  origin 

of  the  procedure.  The  limiting  form  of  X is  given  in  Theorem  3.1  and  the  asymptotic 

normality  of  is  given  in  Theorem  4.1.  Concluding  remarks  along  with  methods  for 

choosing  c and  c are  given  in  Section  5. 

A T 
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2.  The  Bayes'  sequential  procedure.  For  a qiven  prior  distribution  on  6 , the  Bayes* 
sequential  procedure  (BSP)  minimizes  the  total  expected  cost, 

(2.1)  E(0  ^(0-6  )^)  + E(c,  X(0)  + c O) 

OAT 

over  all  pairs  (a,  0^)  . For  a fixed  stopping  time  a , the  first  term  in  (2.1)  can  be 
written  as  E(E(9  (0-  6^^)  ^ | 3(0)))  and  is  minimized  by  ta)ting  to  be  the  Bayes* 

estimator  of  G given  3(0)  . Hence,  the  first  step  in  finding  the  BSP  is  to  determine 
the  posterior  distribution  of  6 given  3(0),  for  any  a . 

Henceforth,  let  9 have  prior  density  'ir(0)  = (’(O^)  Bq^G  e ° for 
0 > 0»  Oq  > 1,  and  6q  > 0,  abbreviated  gamma  ‘ this  prior  density,  the 

posterior  distribution  of  G given  3(t)  , is  gamma  (a^,B^)  , where  ” '^0  ^ 

and  + t . Using  the  loss  defined  in  (1.1),  the  Bayes*  estimator  of  G given 

“1  -1 
3 (t)  is  G^  = B^  (a^-1)  and  the  posterior  expected  loss  using  G^  is  6 ^ . For 

O a stopping  time,  the  posterior  distribution  of  6-  given  3(0)  is  gamma  (a^,B^,)  by 

the  strong  Markov  property  of  the  Poisson  process.  Thus,  the  Bayes'  estimator  of  6 

given  3(0)  is  ' ^0  ^ with  posterior  expected  loss  E (I.(G,G^)  |g  (0) ) = 

For  t ^ 0,  define 

(2.2)  = 6""  + c^  X(t)  + c^t  . 


The  total  cost  of  the  procedure  (0,9_)  is  <2  _ , and  the  expected  total  cost  is  E((2  _)  . 
■ ■ GO  0 

The  Bayes  sequential  procedure  minimizes  E (C 
Ilefine  the  stopping  rule  T by 

(2.3)  T = least  t > 0 such  that  co  -t  c > B ^ 

— A t T t — t 

Note  that  P(T  < ®)  =1,  and  that  T is  very  simple  to  use.  Rule  T will  be  shown  to  bo 
Bayes*  in  Theorem  2.1.  Before  motivating  the  rule.  Lemma  2.1  gives  bounds  for  t and 
X(T)  . 

Lemma  21.  For  T given  by  (2.3), 

i)  T < min(c"^ 

ii)  X(T)  < (c  + 1 . 

— AO 

Proof : Fix  f.  > 0 . Then  ifT>C,  T-t  must  satisfy  the  reverse  inequality  in 


-2- 


I 


expression  (2.3)  defining  T . Thus, 


c_B  + c a < b" 

T T-C  A T-E  T-e 

■1  -“1/2 

This  inequality  first  implies  that  c^B^  e E gives  T - E < . Secondly, 

it  implies  that  c a < B ^ which  gives  c 6,  . < (a_  < a*^  and  thus, 

n l*fe.  A *c*  A T*c  ““  0 

T - E < (ot-c  ) ^ . Also  this  second  form  implies  c a < BT^  which  gives  c X(T-r)  < B„^ 
and  hence  X(T-E)  < ^ . Since  E is  arbitrary  the  proof  is  complete. 

The  motivation  for  rule  T is  given  in  Lemma  2.3.  Briefly,  the  rule  is  derived  from 
the  characteristic  operator  of  the  marginal  process,  X(t) , obtained  from  the  Poisson 
process  by  mixing  over  9 according  to  the  prior  distribution.  Rules  derived  from  charac- 
teristic operators  have  been  considered  by  other  authors,  namely,  Ross  (1971)  and  Starr, 
Wardrop,  and  Woodroofe  (1976),  and  are  sometimes  called  "infinitesimal  loo)c-ahead  rules." 
Such  rules  are  essentially  continuous  time  analogues  of  rules  derived  from  the  monotone 
case  (Chow,  Robbins,  Siegmund,  1971). 

Recall  the  definition  of  in  (2.2).  Define 


AC.  = lim 


E(Ct+hl  (t-x(t))-c^ 


when  the  limit  exists.  Li)cewise,  for  real  valued  bounded  functions  f on  (0,“)  , define 


A f(x)  = lim 
h +0 


E(f  (X(t4h)  I (t,x(t)  ) = (t,x))  -f  (x) 


when  the  limit  exists.  The  expression  in  (2.5)  is  the  characteristic  operator  of  the 
process  X evaluated  at  the  function  f . Note  that  the  marginal  distribution  of  X 
(not  conditional  on  6)  is  used  to  define  (2.4)  and  (2.5).  Thus,  the  process  in  question 
is  not  Poisson,  but  is  obtained  from  the  Poisson  by  mixing  over  the  parameter  9 . Crucial 
in  showing  the  optimality  of  T is  Lemma  2.2  which  states  that  X(t)  is  marginally  a 
strong  Markov  process. 

Lemma  2.2.  Supixjse  that  conditional  on  6,  X(t)  is  a homogeneous  Poisson  process  with 
arrival  rate  9 . Then  for  any  prior  distribution  A on  9 , X(t)  is  marginally  a strong 


Markov  process. 
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Proof.  Using  the  fact  that  P(X(t^)  = k^,  i = l,2,...,rn)  is  equal  to  (for  ^i+1^ 

m 

/ jy  Pg(X(t^-t^_j)  = dA(6),  the  Markov  property  follows  from  a straightforward 

computation.  Since  X(t)  is  marginally  a pure  jump  process,  X(t)  is  strong  Markov. 


Lemma  2.3. 

For  all  t > 0 , 

i) 

AC^  ' 

* va' 

ii) 

AfX  . 

(a^+x) (pQ+t) 

Proof:  C^|a^,01 

= I(6^.+h)"^  - + c^E(x(t+h)  - X(t)|a^,0  ] + c^h 

•=  I(e^+h)"^  - 6'^J  + c^6h  + c^h  . 

Thus,  since  E(0|a  ) = a 0 ^ , EIC  . - C |a  ] is  equal  to 

w W w li»  • II  t w 

l(B^+h)‘^  - + c^oi^.6'^h  + c^h  . 


Dividing  by  h auid  taking  the  limit  as  h tends  to  zero  gives  the  result.  Note  that 
(ii)  is  shown  in  the  body  of  the  proof. 

From  Lemma  2.3,  rule  T can  be  expressed  as 
(2.6)  T = least  t ^ 0 such  that  A ^ 0 . 


Also,  note  that  AC  ^ changes  sign  only  once. 

The  next  lemma  shows  that  Dynkin's  identity  (Brieman,  p.  376)  holds  for  for 


a large  class  of  stopping  times  0.  Note  that  Cq  = 6q 


-1 


I,emnia  2.4.  Suppose  O is  a stopping  time  such  that  E(a)  < “ and  that  X(0)  is  bounded. 
, o 

Then  EC|j  = 6'  + e/  a dt  . 

Proof.  Note  that  ^ “ under  the  hypotheses  of  the  lemma,  and  express  E = 

-1  -2  -1 
EB  c.EX(O)  + c„E(0)  . I,emma  2.3  gives  AC.  = ~P^  + + c_  • Simple  integra- 

OA  T_  tt_AttT 

-1  -2  ~1  ° 

tion  yields  Eg  = E / -g  dt  + g and  E(0)  = E / l dt.  Thus,  the  proof  is  complete 

0 ® ° 

if  E X(o)  is  shown  to  be  equal  to  E J a g dt  . A straightforward  truncation  argu- 

0 

ment  is  used  to  show  this.  Since  X(a)  is  bounded  there  exists  M < “ such  that 


X(0)  < H . Fix  C > 0,  and  define  f (x)  increasing  and  differentiable  for  all  x > 0 

-4- 


such  that  f (x)  • X for  x £ M and  f (x)  = M + e for  x > M + c . Then  f is 

* ° * 

bounded,  A f*  exists,  and  Dynicin's  identity  implies  that  Ef  (X(a))  “ E / A f (X(t))dt  . 

But  f (X(0))  = X(o)  since  X(0)  < M . Also,  f (X(t))  = X(t)  for  all  t O since 

* * ^-1 
X(t)  £ X(0)  on  [t  ^ O]  . Thus,  Ef  |X(0))  = EX(0)  , and  A^f  (X(t))  » A^(X(t))  •= 

on  (t  •£  0]  . 

Theorem  2.1.  For  all  stopping  times  O , E(  C^)  £ E(C^j),  where  T is  given  by  (2.3). 

Proof.  Lemma  2.1  implies  E(T)  < “ and  X(T)  bounded.  Thus, 


E(  C^)  = E / AC^  dt  + B" 


by  Lenma  2.4. 


Let  S = {o:  E(0)  < O’  and  X(0)  bounded)  . If  O is  in  S,  then  EC^  = Bq  + E / A <3t. 


Hence,  E C - E 


C=e/  aC  dt-E/  which  is  nonnegative  since 

ta>T)  (0<T)  ' 


AC^  ^ 0 on  (0  ^ T)  and  AC^  < 0 on  fa  < T]  . Thus,  T is  optimal  in  S . 

If  E C (j  = then  T is  obviously  better.  Thus  consider  O , EC^  < “,  and 
choose  a sequence  of  integers  m^^  increasing  to  <”  . Define  stopping  rule  = D if 
X(0)  £ it\j^  and  = tj^  if  X(a)  > m^^,  where  tj^  is  the  smallest  t such  that  X(t)  = m^^  . 
Then  EOj^  £ EO  < “>,  and  hence  is  in  S for  all  k . Since  t is 

optimal  in  S,  E C £ E for  all  k . Thus,  the  proof  of  the  theorem  will  be  com- 
plete if  E C(j  tends  to  E as  k tends  to  ■>  . Write  E = ECg[X(0)  £ + 

”k  k 

EC  [X(o)  > ni]  . The  first  term  tends  to  E C^,  by  the  monotone  convergence  theorem. 

^k  * 

^ -1 

For  the  second  term,  E IX(o)  > < B^  P(X(a)  > mj^)  + EC^^lXta)  > m^^]  since  X(o)  > 

k 

implies  t < o . Both  terms  above  tend  to  0 since  EC_  < ® • 
k o 
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3.  Largo  sample  properties  of  T . In  this  section  the  Bayes'  procedure  (r  , 0^)  is 

examined  in  the  classical  framework.  The  parameter  6 is  considered  fixed  but  unknown 

and  all  probeibilities  and  expectations  are  conditional  on  6 and  denoted  by  P_  and  E„  , 

9 9 

respectively.  The  procedure  (t,9  ) does  not  minimize  E„  C for  all  6 , but  only  the 

T 9 0 

average  of  over  the  prior  distribution  of  Section  2. 

The  large  sample  properties  of  the  procedure  are  studied  by  letting  the  sampling 
costs  tend  jointly  to  zero.  Define 

(3.1)  t*  = t*(6)  = (c  e + . 

A T 

The  main  result  of  this  section  (Theorem  3.1)  is  that  T is  asymptotically  equivalent  to 

* -1 
t as  £ = tends  to  0^  = (0,0)  with  converging  to  ^ • 

As  motivation  for  this  limiting  form  of  T , note  that  ^0 C ^ is  equal  to 

+ c^G  t + c^t  . Let  H(x)  = (6q  + x)  ^ + c^G  x + c^x  . Then  H attains  a unique 

-1/2  * 
minimum  at  x = (c.G  + c ) - B,.  . Ignoring  gives  t 

A T O f) 

The  following  lemmas  give  rates  and  uniform  integrability  results  needed  in  the  proof 
of  Theorem  3.1. 

Lemma  3.1.  For  each  £ > 0 , 

Pgdd/t*)  - l|  > e)  < 2 exp(c‘^^^  D(c,E))  , 

where  D(c,£)  -►  D(t)  < 0 and  finite  as  c^,  -»■  0 along  any  sequence  for  which 

c»o_^  -»■  c„,  0 < c„  < “ . 

AT  0 0 — 

Proof.  Note  that  {t  > t}  = {x(t)  < B.},  where  B.  = (c.B.)  ^ - c_B  c.^  - a.  . Let 
t tAt  TtA  0 

* * 

t^  = (1  + £)t  . Then  P„(T/t  > 1 + c)  = P. (X(t  ) < B^  ) . Since  X(t  ) is  Poisson 

t U 9 E.  G 

(9t^) , Bernstein's  inequality  implies  that  for  all  u > 0 , 

P„(X(t  ) < B^  ) < exp(u  ) E„exp(-u  X(t^)) 

0 L t^  — t^  0 E 

= exp(u  B + G t (e  - 1)) 

E ^ 

-1/2 

= exp(c.  u B(c,  t , u)),  where 
A — E 


Since  ^ ^ easy  to  show  that  t^  and  c^'  8^  both  tend  to 
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fi 


-1  “1/2 

(1  + e)  (0  + Cq  ) . Thus,  as  sampling  costs  tend  to  0,  B(c,  t^,u)  -*■  B(e,u)  , where 

B(e,u)  = (1  + e)‘^0  + - (1  + e)(6  + _ ^-Uj  ^ ^-1^  _ 

Now,  the  limit  of  B(E,u)  as  u tends  to  0 is  negative  and  finite,  and  hence  B(£,u)  < 0 
for  all  u < Uq  depending  on  E.  Choosing  d‘^(c,E)  » UpB(c,t^,Ug)  yields  the  appropriate 
rate  for  (T/t  > 1 + e)  . For  the  lower  probability,  define  t”  = (1  - E)t*  and  write 
Pg(T/t  < 1 - E)  = PgCXCt^)  ^ i expCuc^  ^ (-B(£,  t^,  -u) ) ) . As  above,  there  exists 

“o  ^ ® that  B(c^,  t^,  ~Uq)  ^ 0,  and  thus  D (£,E>  may  be  chosen  as  -u^B (c , t” , -u^)  . 

The  proof  is  completed  by  taking  D(c,  E)  = max(D''^,D”)  . 


Lemma  3.2.  For  any  E > 0 , 


Pa(|(T/t  ) - l|  > E)  < 2exp(c^'^^  c/  D(c,E))  , 


T A - 


where  D(c,E)  D(e)  < 0 and  finite  as  c^,  0 along  any  sequence  such  that 

0 • 

A T 


Proof.  As  in  the  proof  of  Lemma  3.1, 


Pg(T/t  > 1 + E)  < exp(u  B^  - 9t  (1  - e‘“)) 

E 

1/2  -1 

■=  exp(c,j,  c^  u G(c,t^,u))  . 

Using  the  fact  that  t^  and  6^  both  tend  to  (1+E)  and  the  methods  of 

T I «i  ( 3.1  complete  the  proof. 

Lenria  3.3.  As  c . c_  0 such  that  e r ^ r'  < o»  . 

AT  A T 0 - ' 


i)  T/t  is  uniformly  integrable  (Pg)  , 

* 

ii)  t /(Bg  +T)  is  uniformly  integrable  (Pg) 


I * 

Proof.  Let  Y = = I (T/t  ) - l|  . It  suffices  to  show  that  for  a > 0 fixed, 

lim  / Y dPg  = 0 as  ^ ^0  — suppose  that  ^ ^ 

{Y>a}  -1/2  -1  1/2 

Lenna  2.1,  Y £ c^  (0  + c.j,c^  ) . Thus,  Lemma  3.1  implies  that 

^Y>a)  «p(c;^^2  D(c,  a)) 


I 
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which  tends  to  0 as  ^ ^0  ^ ° * Secondly,  suppose  '*  ^ * Then  Lemma  2.1 

-1  1/2 

implies  Y < (c.c  6+1)  . Thus,  Lemma  3.1  implies  that 

— AT 

/ ’f  dP„  < (c  c"^  0+1)  exp(cyV^  D(c,a)) 

{Y>a}  oat  T a 

which  tends  to  0 . 

* * ^1/2  -1 

To  prove  (ii) , note  that  t /($^  + T)  < t /3^  = (c^0  + c^)  ' 6^  , and  apply  the 

same  techniques  as  in  (i) . 

Theorem  3.1.  If  c.,  c_"*'  0 such  that  c c ^ + c < “>,  then 

AT  A T 0 — 

* 

i)  T/t  -►  1 (in  P0  probability)  , 
ii)  Eg  (T/t*)  + 1 . 

Proof.  The  results  follow  immediately  from  Lemmas  3. 1-3. 3. 

-1  * 

Corollary  3.1.  If  c.  , c +0  such  that  c c + c < ”“,  then  t E,,  f + 2 . 

^ AT  ATO—  0-^T 

-1  * 

Proof.  Eg  = Eg(6j^  +T  ) + c^0E(T)  + C^E(T)  by  Wald's  Lemma.  Thus,  t EgC^^  = 

* ♦ 

E^Ct  /(Sq+T))  + E^d/t  ) -►  1 + 1 = 2 by  Theorem  3,1  and  Lemma  3.3. 


4.  Asymptotic  normality  of  6^  . Once  the  limiting  form  of  T is  found,  the  asymptotic 
distribution  of  0^  is  obtained  by  standard  methods.  First  a well  known  result  for 
random  sums  of  random  variables  is  stated. 


Lemma  4.1.  Suppose  are  independent  and  identically  distributed  with  mean  0 

and  variance  1,  eind  that  N is  an  integer  valued  random  variable  tending  to  “ as  sampling 


costs  tend  to  0 . If  there  exists  n , nonnrandom,  such  N/n  tends  to  1 (in  proba- 
bility) then 


(N)  J Y.  -♦  Z (in  distribution) 

i=l  ^ 


where  Z is  normal  with  mean  zero  and  variance  1 . 

Proof.  See  Renyi  (1957) . 

Lemma  4.2.  As  sampling  costs  c^,  c^  tend  jointly  to  zero  along  any  sequence  such  that 

(t9)  (X(T)  - T0)  -*■  Z (in  distribution) 

where  Z is  normal  with  mean  zero  and  variance  one. 

n 

Proof.  For  each  n = 1,2,...,  X(n)  = \ Y.,  with  Y.  = X(i)  - X(i-l)  independent  and 

i=l  ^ ^ 

identically  distributed  Poisson  (6)  . Define  N = [T  + 1) , where  (.]  is  the  greatest 

integer  function.  Then  N an  integer  valued  random  variable  with  respect  to  ^ 5^^  ' 

with  ^ the  sigma  algebra  generated  by  Y , . . . ,Y  . Also,  Theorem  3.1  implies  that 
n In 

* 

N/t  tends  to  1 in  probability  since  T < N ^ T + 1 . Thus,  Lemma  4.1  implies  that 
-1/2 

(nO)  (X(N)  - 0N)  tends  to  Z in  distribution. 

Now,  T < N 1 i + 1 implies  X(N)  ^ X(T)  and  X(N)  - X(T)  < X(T  + 1)  - X(T)  . 

Thus,  for  any  C > 0 , 

• -1/2  * -1/2  -1 
Pg((t  ) ' (X(N)  - X(T))  > C)  < (t  ) ' E Eg(X(T+l)  - X(T)) 

• -1/2  -1  * -1/2  • -1/2 
= (t  ) ' e 0 which  tends  to  0 . Thus,  (t  ) X(N)  - (t  ) X(T) 

* 

tends  to  0 in  probability.  Next,  since  N/t  tends  to  1 in  probability. 


-1/2  -1/2 

then  N X(N)  - N X(T)  tends  to  0 in  probability.  Thus, 


-9- 


(X(T)  - N0)  tends  to  z in  distribution.  Using  N/T  tends  to 


(X(T)  - n6)  tending  to  Z in  distribution 


Finally 


(X(T)  - T0)  = (T0) 


(X(T) 


0 in  probability  since  N - T < 1 


Theorem  4 . 1 


Z (in  distribution)  where  Z is  normal  with  mean  0 


(X(T) 


The  second  term  tends  to  0 in  probability.  The  1st  term  tends  to  Z in  distribution 


using  Lemma  4.2 


5.  Concluding  remarks.  Although  Bayesian  methods  are  used  to  derive  the  procedure 


(T»0^  )»  the  procedure  has  desireible  properties  in  the  classical  framework,  and  these 

properties  are  of  course  independent  of  the  prior  distribution  of  Section  2.  In  particular, 

* * 

the  rule  T is  shown  to  be  asymptotically  equivalent  to  t (Theorem  3.1)  where  t is 

approximately  the  best  fixed  Scunple  size  procedure  when  0 is  known.  Thus,  the  asymptotic 

* 

equivalence  of  T and  t is  a very  strong  property. 

The  stopping  rule  T also  has  desirable  small  sample  properties.  A common  criticism 
of  sequential  procedures  is  that  they  may  be  unbounded.  As  shown  in  Lemma  2.2,  T is 
bounded,  and  in  addition,  X(T)  is  bounded.  Since  in  applications,  the  arrivals  of  a 
Poisson  process  may  represent  the  failures  of  expensive  experimental  units,  or  failures 
of  treatments,  a rule  O with  X(0)  bounded  may  be  desirable  for  monetary  or  ethical 
considerations. 

Furthermore,  the  bounds  given  in  Lemma  2.2  may  guide  the  experimienter  in  his  choice 

of  costs.  If  the  experimenter  decides  that  the  experiment  must  terminate  by  time  A or 

that  the  number  of  arrivals  observed  must  not  exceed  B,  then  costs  c and  c_  can 

A T 

be  selected  so  that  the  bounds  given  in  Lemma  2.1  are  less  than  A and  B respectively. 
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